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Abstract 

Future stratospheric ozone concentrations will be determined both by changes in the 
concentration of ozone depleting substances (ODSs) and by changes in stratospheric 
and tropospheric climate, including those caused by changes in anthropogenic green- 
house gases (GHGs). Since future economic development pathways and resultant 
emissions of GHGs are uncertain, anthropogenic climate change could be a significant 
source of uncertainty for future projections of stratospheric ozone. In this pilot study, 
using an “ensemble of opportunity” of chemistry-climate model (CCM) simulations, the 
contribution of scenario uncertainty from different plausible emissions pathways for 
ODSs and GHGs to future ozone projections is quantified relative to the contribution 
from model uncertainty and internal variability of the chemistry-climate system. For 
both the global, annual mean ozone concentration and for ozone in specific geograph- 
ical regions, differences between CCMs are the dominant source of uncertainty for the 
first two-thirds of the 21st century, up-to and after the time when ozone concentrations 
return to 1980 values. In the last third of the 21st century, dependent upon the set of 
greenhouse gas scenarios used, scenario uncertainty can be the dominant contributor. 
This result suggests that investment in chemistry-climate modelling is likely to continue 
to refine projections of stratospheric ozone and estimates of the return of stratospheric 
ozone concentrations to pre-1980 levels. 
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1 Introduction 


Over the past four years the chemistry-climate modelling community has made progress 
in understanding and refining projections of stratospheric ozone over the 21st century. 
For the first time, a large number of Chemistry-Climate Models (CCMs) have been run 
5 using common ozone and climate forcings for the period 1960-2100 for the second 
phase of the Stratospheric Processes And their Role in Climate (SPARC) Chemistry- 
Climate Model Validation Project (CCMVal2). The set of model integrations provided 
by 1 8 modelling centres around the world has been extensively interrogated by a large 
number of authors and a comprehensive report detailing our current understanding of 
io the CCMs was completed early in 2010. As part of CCMVal2, a new analysis of un- 
certainty in projections of total column ozone over the 21st century and dates of return 
of total column ozone has been produced (Chapter 9, SPARC CCMVal (2010)). This 
analysis, however, has been conducted for reference simulations of CCMs based on a 
common GHG forcing scenario. Many recent studies have pointed to the role that fu- 
i5 ture changes in GHG concentrations might play in determining both global and regional 
ozone abundances over the 21st century (Shepherd (2008), Waugh et al. (2009), Jon- 
sson et al. (2009), Oman et al. (2010a)). GHGs can affect ozone concentrations 
through the additional HOx and NOx production from increases in CH 4 and N 2 0 de- 
composition, through acceleration of catalytic ozone destruction cycles in the colder 
20 stratosphere and indirectly by influencing the strength of the Brewer-Dobson circula- 
tion and hence the meridional and vertical transport of ozone (Barnett et al. , 1974; 
Randeniya et al. , 2002; Rosenfield et al. , 2002; Haigh and Pyle , 1982; Chipperfield 
and Feng , 2003; Portman and Solomon , 2007; Ravishankara et al. , 2009; Butchart 
et al. , 2006) 

25 Given the sensitivity of ozone amounts to GHG concentrations, there is an addi- 
tional uncertainty in projections of ozone column amounts due to the uncertainty in the 
use of fossil fuels and other GHG producing compounds over the next 100 years. In 
the climate change community, this uncertainty is addressed by producing projections 
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of climate variables using a range of different possible GHG scenarios (SRES Naki- 
cenovic et al. (2000)), consistent with economic models of global development. While 
these scenarios do not necessarily span the full range of possible GHG emissions, they 
do at least allow an estimate of the sensitivity of climate models to different economic 
development paths. 

In this study, additional simulations of the CCMs used for the CCMVal2 intercom- 
parison forced with different GHG scenarios (and in some cases slightly different ODS 
scenarios) are used to quantify the uncertainty in global and regional stratospheric 
ozone projections associated with three factors: model uncertainty, scenario uncer- 
tainty and internal variability. By separating the overall uncertainty of CCM projections 
in this way, it is possible to identify regions in which: 

- model uncertainty is dominant, such that projections could be improved by CCM 
development leading to a narrowing of this uncertainty, 

- scenario uncertainty is dominant, such that additional simulations of CCMs forced 
with different GHG scenarios would enable a better understanding of future ozone 
abundances, and 

- internal variability is relatively large, such that there will be significant component 
of the total uncertainty which is irreducible. 

Identifying regions and time periods where these conditions are found will aid future 
CCM ensemble design and inform policymakers about the potential to narrow uncer- 
tainty in ozone projections. 


2 Model Integrations 


Model integrations used in this analysis form part of the CCMVal2 intercomparison 
project. The core set of integrations used are so-called future reference simulations 
(REF-B2) from the CCMVal2 activity. These simulations are described and assessed 
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in detail in the SPARC CCMVal report (SPARC CCMVal, 2010) and the participating 
CCMs are described in Morgenstern et al. (2010) and references therein. REF-B2 
simulations use surface time series of halocarbons based on the adjusted Al scenario 
from WMO (2007), and the long-lived GHG concentrations are taken from the SRES 
s Al b scenario Nakicenovic et al. (2000). Sea surface temperatures (SSTs) and sea ice 
concentrations (SICs) are generally prescribed from coupled ocean model simulations, 
either from simulations of the same atmospheric GCM run with a coupled ocean, or 
from coupled ocean-atmosphere model simulations of a different AR4 GCM simulation 
under the same Al B GHG scenario. Only one of the 1 3 CCMs used here ran with a 
io coupled ocean (CMAM). 

To avoid artifacts from using different numbers of models as time progresses [Chap- 
ter 9 of SPARC CCMVal, 2010; Waugh and Eyring, (2008)], only the subset of 13 
CCMVal REF-B2 simulations that provided output from 1960-2095 are used in this 
study. 

is In addition to these REF-B2 simulations, several other model integrations which pri- 
marily varied the GHG scenario are also analysed. Five different GHG scenarios are 
considered, with the models running each scenario listed in Table 1 . Two scenarios 
were run with different SRES pathways (SRESA2 and SRESB1) but with an identi- 
cal ODS scenario to the standard REF-B2 runs. Three additional scenarios were run 
20 by one model (CAM3.5), consistent with the new coordinated Climate Change Sta- 
bilization Experiments proposed for climate models (Meehl et al. , 2007). These new 
Representative Concentration Pathways (RCPs, Moss et al. (2008)) were generated by 
Integrated Assessment Models (lAMs) and were harmonized with the historical emis- 
sions from Lamarque et al. (2010) in both amplitude and geographical distribution. The 
25 RCP simulations that were performed with CAM3.5 are RCP 8.5 (Riahi et al., 2007), 
RCP 4.5 (Clarke et al., 2007), and RCP 2.6 (van Vuuren et al., 2007)). In addition to the 
large differences in GHG amount, the RCP scenarios also differ in the concentration of 
ODS amounts over the 21st century (although to a lesser degree than the differences 
in GHG amount). 
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Therefore the predominant influence on ozone amounts in the different scenarios 
considered here is that of changing GHG quantities. The following analysis will there- 
fore attempt to quantify the impact of uncertainty in future GHG scenario on the evolu- 
tion of stratospheric ozone. There also remains some uncertainty in future emissions 
5 of ODS amounts which is outlined in detail by Chapter 8 of WMO (2007). For example 
a hypothetical elimination of ODS emissions from both continued ODS production and 
halocarbon banks in 2006 would have accelerated the return of Effective Equivalent 
Stratospheric Chlorine (EESC) to pre-1980 levels by 15 years according to calcula- 
tions in WMO (2007). These uncertainties are not addressed in this study, and should 
io be considered as another source of potential scenario uncertainty that might be quanti- 
fied in the future. Separation of the impacts of GHG and ODS changes on stratospheric 
ozone amounts for the CCMVal2 models is discussed in Eyring et al. (2010). 


3 Methods for quantifying uncertainty 

In two previous studies, Hawkins and Sutton (2009, 2010) quantified the uncertainty in 
is global and regional near surface temperature and precipitation using a suite of model 
integrations from phase 3 of the Coupled Models Intercomparison Project (CMIP3). 
We adapt these methods to examine the sources of uncertainty in projections of strato- 
spheric ozone for the 21 st century, focussing on specific regions and the date of return 
of ozone to 1980 levels. 

20 A detailed description of the methods used can be found in the appendix of Hawkins 
and Sutton (2009), but the approach is briefly outlined below for an ideal ensemble of 
CCM simulations. We also discuss some necessary changes to the methodology to 
accomodate issues specific to ozone projection. 


6 



3.1 Separating the sources of uncertainty 

For an ideal ensemble of simulations ( which is not available for the CCMVal ozone 
projections) the following approach to separating the sources of uncertainty in ozone 
projections could be followed. 

5 It is assumed that the total variance in future ozone concentrations (T 2 ) as a function 
of time ( t ) can be separated into three components, 

T(t ) 2 = M(t ) 2 + S(t ) 2 + I 2 , 

where M(t ) 2 represents uncertainty due to the use of different models, S(t ) 2 repre- 
sents the variance in projections associated with different future emissions scenarios 
and / 2 represents variance associated with internal variability in ozone concentrations, 
io which is assumed to be constant in time (this assumption is discussed further below). 

To estimate the different components, a smooth curve is fitted to each model in- 
tegration, and the variance of the residuals represents the contribution from internal 
variability. The multi-model mean of this quantity then represents an estimate of I 2 . In 
Hawkins and Sutton (2009, 2010) a fourth order polynomial is used, but for the ozone 
15 projections, the smooth curve is created by using a Gaussian filter, with full width at 
half-maximum of 20 years, on the annual data. The variance of the ensemble around 
the multi-model mean is considered as the model uncertainty, and this is averaged over 
the scenarios to give an estimate of M 2 . Finally, the variance of the multi-model means 
for each scenario is considered as the scenario uncertainty, S 2 . 

20 Each model is assumed to be independent and equally realistic, i.e. no effort is 
made to weight the models by their ability to simulate historical changes in ozone. The 
analysis can be repeated for different seasonal means and regions. 

In all cases, decadal mean ozone concentrations are considered, since ozone pre- 
dictions from CCMs are typically used to examine and quantify the long-term changes 
25 in ozone amounts rather than predict the amount of ozone present in any given year. 
This means that our estimates of internal variability (I 2 ) represent changes on decadal 
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or longer timescales, and do not consider (for example) the interannual variability in 
ozone which is large for some geographical regions and seasons. 

Additionally, for ozone projections it is common to consider variations from 1980 total 
column amounts. To calculate the ozone offset, a smooth value for the 1 980 total ozone 
column for the particular region and season considered is calculated by applying the 
same Gaussian filter to the raw total column ozone data. The procedure described 
above is then applied to anomalies from this smooth 1 980 value in the total column 
ozone data. 

3.2 Application to ozone projections 

An ideal multi-model ensemble for this analysis would comprise integrations of a large 
number of different CCMs each forced by a large number of GHG scenarios. In the 
studies of Hawkins and Sutton, uncertainty in projections of surface temperature and 
precipitation are quantfied using 15 coupled ocean-atmosphere GCMs which all ran 
simulations with three different GHG emissions scenarios. Unfortunately an ensemble 
of CCM simulations of similar size is not currently available (see Section 2). In order 
to make progress in quantifying the uncertainty in ozone projections it is necessary to 
make some approximations to the methodology described above. Since the simula- 
tions available comprise a large ensemble of model integrations with a single scenario 
and only a small ensemble of simulations from a subset of the models (13 CCMs for 
the REF-B2 ensemble and 2 CCMs for each alternative GHG scenario) with different 
scenarios, a logical first approximation is to restrict the calculation of model uncertainty 
and internal variability to the single scenario ensemble (labelled REF-B2 above and 
using SRESAlb GHG forcings). This step assumes that model uncertainty and in- 
ternal variability in other scenarios is consistent with that in the REF-B2 simulations. 
This has the added benefit that estimates of model uncertainty should be consistent 
with the estimates previously made in the CCMVal2 report (Chapter 9, SPARC CCM- 
Val (2010)). Estimation of scenario uncertainty is more difficult, since it is important to 
avoid contaminating our estimate of scenario uncertainty with model uncertainty. 
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In this pilot study, two methods are used to estimate scenario uncertainty. The first 
method uses four simulations from three different CCMs (CCSRNIES, GEOSCCM and 
WACCM) which are forced with alternative scenarios from the SRES emissions sets. 
The second method uses runs from a single CCM (CAM3.5) which is forced with al- 
5 ternative scenarios from the RCP emissions set. This separation is motivated both 
by the slightly different nature of the simulations in the SRES and RCP sets and also 
by the fact that the SRES and RCP forcing sets are designed to separately estimate 
the potential spread in future economic and technological development over the 21st 
century, leading to different emissions of climate relevant gases. Note that the spread 
10 in emissions of carbon dioxide, methane and nitrous oxide are much larger in the RCP 
scenario set than for the SRES scenario set over the 21st century. 

3.2.1 Method 1 : Estimation of scenario uncertainty from single scenarios of 
multiple models 

In an ideal ensemble of simulations, the scenario uncertainty would be estimated by 
is first calculating the multi-model mean trend of an ensemble of CCM simulations forced 
with each chosen scenario, and then estimating the standard deviation of the scenario 
specific multi-model mean. Given the small number of scenario runs available, one way 
to make progress is to attempt to estimate the smooth evolution of a large multi-model 
ensemble based on the scenario runs available. These estimate of the multi-model 
20 ensemble mean for each scenario will be denoted as the pseudo multi-model mean 
timeseries for each scenario. Scenario uncertainty is then estimated by calculating the 
standard deviation of the multi-model mean for the reference scenario and the pseudo 
multi-model mean time series for the other GHG scenarios. 

It is assumed that an estimate of the shift of the multi-model mean in each scenario 
25 can be made by first measuring the difference in the evolution of ozone in each model 
between its simulation in that scenario and in the REF-B2 scenario ( shf{t) m ). For 
example, 
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shf(t)wACQM =x(i)wACCM,SRESBl— ®(i)wACCM,REF-B2- 

is the shift for the WACCM model. An estimate of the shift of the multi-model mean 
for each scenario can then be made by taking the mean of the model-specific shifts, 

shf(t) = Y,shf(t) m . 

m 

The pseudo multi-model mean time series (pmmt) is then estimated from the REF- 
62 multi-model smooth time series ( mmt(t )) as (in this example for the SRESA2 sce- 
nario): 


pmmt(t) sresbi = mmt(t ) + shf(t) sresbi 

This procedure is equivalent to assuming that the difference between each model 
integration and the multi-model mean in each scenario is the same as the difference 
between that model and the multi-model mean in the REF-B2 run. It is also consistent 
with the assumption that the variance of the model ensemble remains the same in 
each scenario run. This is a simple assumption, but it has the advantage that it is 
easily reproducible and allows progress to be made in assessing the relative sizes of 
scenario and model uncertainty. 

To test this procedure, it was applied to a set of six CCM simulations which as- 
sumed GHG concentrations remained fixed at their 1960 levels from 1960-2100 (note 
that these simulations are not used elsewhere in this study, but are extensively docu- 
mented in Eyring et al. (2010). This set of simulations will be referred to as the fGHG 
simulations). Fig. 1 shows the smooth trend in global mean total column ozone (relative 
to 1960 values) of the multi-model mean for the REF-B2 simulations of the six models 
(solid black line) and the multi-model mean for the fGHG simulations of the six models 
(dashed black line). The procedure for the estimation of the pseudo multi-model mean 
trend for the fGHG scenario based on a limited number of CCM simulations is illustrated 
by the grey, blue and yellow lines. In each case, the grey, blue or yellow line represents 

10 



an estimate of the fGHG multi-model mean calculated by adding shf(t ) calculated from 
a single CCM onto to the multi-model mean of the REF-B2 simulations. Each of the 
grey lines is an estimate of the dashed black line calculated by a simple average of 
the six fGHG simulations. Clearly, for a single CCM, the estimate of the multi-model 
mean can be very different to the true multi-model mean. In the case of CCSRNIES 
(yellow line) and WACCM (blue line), which, along with GEOSCCM, ran SRES GHG 
sensitivity simulations used in the later analysis, both models somewhat overestimate 
the sensitivity of the global mean ozone column around the time of maximum ozone 
depletion, but by the end of century are close to the multi-model mean. 

For the global mean and similar tests in other geographical regions (not shown) when 
the pseudo multi-model mean is calculated from two model integrations (red line in this 
example) the estimate is closer to the true multi-model mean. Of course, as more 
and more scenario simulations are added to the average shift calculation the pseudo 
multi-model mean timeseries will better approximate the true multi-model mean. The 
example calculations here show that for two models, the pseudo multi-model mean is 
reasonably close to the true multi-model mean and generally approximates the main 
features of the true multi-model mean. 

3.2.2 Method 2: Estimating scenario uncertainty from runs of a single CCM 

An alternative method for estimating scenario uncertainty is to use multiple simula- 
tions of a single CCM forced with a range of different scenarios. A set of simulations 
of this type is available for the RCP forcing scenarios from the CAM3.5 CCM. Since 
three simulations of this model with different RCP scenarios are available it is trivial to 
calculate the time evolving scenario uncertainty by computing the standard deviation 
of the ensemble of three CAM3.5 simulations. This estimate of scenario uncertainty 
can be compared to the estimates derived from method 1 , and together with the esti- 
mates of model uncertainty and internal variability from the REF ensemble to provide 
a breakdown of the uncertainty in ozone projection. 

For the RCP scenario simulations of CAM3.5, there are significant differences in the 
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tropospheric ozone column between the runs, because tropospheric ozone pre-cursors 
vary between the different scenarios. Since the focus of this study is on uncertainties 
in projections of stratospheric ozone, when calculating scenario uncertainty from the 
RCP simulations of CAM3.5 only the ozone column above 200hPa is considered. 

5 The major disadvantage of this approach is that it relies completely on an accu- 
rate simulation of the sensitivity of stratospheric ozone to each forcing scenario by the 
CAM3.5 model. If this model over or under estimates the sensitivity of stratospheric 
ozone to changes in for example GHG amounts then the estimate of scenario uncer- 
tainty will be similarly biased. 


10 4 Results 

4.1 Global mean ozone 

To introduce the concept of our quantification of uncertainty we first show a time series 
of the global and annual mean, total column ozone (Fig. 2). The modeled evolution of 
ozone for both the past and projected future is shown (in grey), calculated by computing 
is the ensemble mean of the REF and SRES simulations and is identical in both panels. 
Estimates of the model uncertainty and internal variability are drawn from the REF-B2 
simulations, and are identical in the two panels. Shaded regions show the one standard 
deviation uncertainty associated with each of the three uncertainty components. The 
two panels use the two alternative methods of estimating scenario uncertainty using 
20 the SRES scenario simulations (top panel) and the RCP scenario simulations (bottom 
panel). 

Considering first the top panel, it is clear that when using the SRES scenario simu- 
lations, total uncertainty is similar throughout the 21st century, with a small reduction 
around the 2040s as ozone returns to its 1980 values. The relative contributions of 
25 model uncertainty (blue) and scenario uncertainty (green), however, change markedly 
over the course of the 21 st century. For short lead times, close to peak ozone depletion, 
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model uncertainty is large, and is likely related to the variation in stratospheric inorganic 
chlorine (Cl y ) (Eyring et al., 2007) and related variations in chemistry, dynamics and 
transport between the models. By the end of the 21st century, when Cl y concentrations 
have returned to pre-1980 levels, model uncertainty is significantly smaller. 

5 It is worth noting in passing that while running initial condition ensembles of ozone 
projections would help to better determine the mean smooth trend of ozone, the un- 
certainty in the projections related to internal atmospheric variability would remain. 
As described in the methods section, internal variability is estimated from the model 
integrations themselves and is assumed to be constant throughout the period of the 
io runs. Examination of the time-evolving residuals for both the global ozone and other 
geographical regions revealed that in general there are no significant changes in the 
internal variability estimated from the 13 models in the REF-B2 ensemble. For global 
mean values, there are variations of around 0.1 DU in the one standard deviation es- 
timate of internal variability, with a small trend toward smaller internal variability over 
is the course of the 21st century. For the polar regions, there is slightly more variation in 
the estimate of internal variability (as expected given the smaller averaging area and 
shorter averaging period) with larger variations over Antarctica of around 2-3 DU and a 
peak in internal variability near to the period of maximum ozone depletion. We consider 
these variations to be small enough that an assumption of constant internal variability 
20 is a valid first approximation for the analysis conducted in this study. It is also important 
to note that since internal variability is estimated from the models themselves, it could 
be larger than the estimate shown here if the models under-represent tropospheric 
and stratospheric internal variability, but given the limited observational record (black 
dots in Fig. 2) it is difficult to assess the magnitude of the internal variability. Addi- 
25 tionaly, if projections of annual mean global mean ozone were considered, (rather than 
projections of decadal mean global mean ozone) internal variability would be a larger 
contributor to the total uncertainty in ozone projections (increasing by around a factor 
of 2). 

From the middle of the 21st century, scenario uncertainty begins to play a bigger role 
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in determining the total uncertainty, as expected, since the input GHG concentrations 
only start to significantly diverge in the second half of the 21st century. By the end of 
the 21st century, when GHG concentrations in the various scenarios have significantly 
diverged, their impacts on stratospheric temperatures, and hence on the rates of gas- 
5 phase ozone loss cycles and changes in stratospheric circulation can be clearly seen 
by the growth of the scenario uncertainty component. Despite this growth in scenario 
uncertainty in the SRES simulations, model uncertainty remains the largest contributor 
to the total uncertainty in global ozone throughout the 21 st century. 

In contrast to the SRES scenario simulations, scenario uncertainty is a larger compo- 
io nent of the total uncertainty in the RCP scenario simulations. Given the larger spread 
in GHG amounts in the RCP simulation this would have been expected a priori. How- 
ever, scenario uncertainty from the RCP scenarios begins to dominate uncertainty in 
global mean ozone only by the later third of the 21st century, and not before global 
mean ozone has returned to its pre-1980 values. The enhanced scenario uncertainty 
is also means that the total uncertainty in projections of total ozone is larger, but only 
by a factor of around 20% by the end of the 21st century when compared to the total 
uncertainty computed using SRES scenario uncertainty. 

One benefit of dividing ozone projection uncertainty into model, scenario and internal 
variability components is that it gives an indication of the benefit in narrowing projec- 
20 tion uncertainty that can be made by improving CCMs and where this improvement is 
likely to be most beneficial. In discussing these improvements, it is assumed that by 
improving CCMs, model uncertainty will be reduced, whilst scenario uncertainty will 
remain constant, since scenario uncertainty is primarily related to future global devel- 
opment paths. Under this assumption, results for both the SRES and RCP scenario 
25 cases suggest that it should be possible to narrow uncertainty in ozone projections 
throughout the 21 st century by reducing model uncertainty. Projections of the increase 
in global column ozone amounts above 1980 values by the end of the 21st century are 
more dependent upon the concentrations of GHGs at this time. In general, scenarios 
with larger emissions of GHGs (SRESA2, RCP8.5) tend to produce larger amounts of 
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ozone at the end of the 21 st century. 

4.2 Uncertainty in ozone projections in different geographical regions 

A similar quantification of uncertainty can be performed for total column ozone pro- 
jections for various geographical regions and seasons to highlight the different be- 
haviour of ozone and the importance of different physical processes in determining 
future ozone behaviour. In this analysis we consider similar regions to WMO assess- 
ments of future ozone listed in Table 2. 

Uncertainty in the three different components, along with the total uncertainty is 
displayed in units of one standard deviation in Fig. 3. Broadly, the same behaviour 
as identified in the global ozone concentrations is seen, with total uncertainty (black 
lines) roughly constant throughout the 21st century when SRES simulations are used 
to assign scenario uncertainty. In general, there is also good agreement in both the 
estimated magnitude and temporal evolution of scenario uncertainty between the two 
independent estimates derived from the SRES (solid green lines) and RCP (dashed 
green lines) scenarios. Note that scenario uncertainty for both the SRES and RCP 
estimates is close to but not equal to zero at initial time, at this time in both the SRES 
and RCP scenarios there is almost no difference in GHG concentrations, suggesting 
that the small offset here is related to uncertainties in the estimation of the S(t) 2 term. 

In most regions, when SRES scenarios are considered, model uncertainty remains 
the dominant term in the uncertainty budget throughout the 21st century. When sce- 
nario uncertainty is calculated from the RCP scenarios, in some regions (Global mean, 
SH mid-latitudes) total uncertainty undergoes a transition from model dominated un- 
certainty to scenario dominated uncertainty at some time in the last third of the century. 
However, there are significant differences to this behaviour in different regions. 

In the tropics, model uncertainty remains a large contributor to the uncertainty through- 
out the 21 st century and grows slightly from 2000 to 21 00. SRES and RCP scenario 
uncertainty remains small throughout the 21st century. The evolution of tropical col- 
umn ozone is determined by the balance between increases in upper stratospheric 
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ozone due to stratospheric cooling and decreases in lower stratospheric ozone due to 
increases in the strength of the Brewer-Dobson circulation. Comparison of vertically re- 
solved ozone changes (not shown) indicate that a robust feature in the GHG sensitivity 
simulations is that, in the tropical upper stratosphere, the lower GHG scenarios gen- 
5 erally result in lower ozone (due to smaller GHG-induced ozone increases), whereas 
in the lower stratosphere the lower GHG scenarios result in higher ozone (due to less 
tropical upwelling that advects ozone-poor air from the troposphere). However, in the 
upper stratosphere, factors other than GHG induced cooling play a role in the ozone 
decreases, so that e.g. the ozone evolution in the SRES A2 and SRES A1 b simulations 
10 are very similar (Oman et al. , 2010a). 

All CCMs also consistently predict an increase of tropical upwelling with increas- 
ing GHGs, but the significant variation in Brewer-Dobson circulation strength that was 
found amongst the CCMVal2 models (Chapter 4, SPARC CCMVal (2010), see also 
Fig. 7 of (Eyring et al., 2010)) plays a significant role in determining the large model 
is uncertainty and its growth with time (since models with larger tropical upwelling mass 
flux also tend to exhibit larger trends in mass flux over the 21 st century (Chapter 4, 
SPARC CCMVal (2010)). Consequently, uncertainty in projections of tropical ozone is 
likely to significantly benefit from improvements in CCMs transport schemes as well as 
improvements in the underlying dynamics of the General Circulation Models (GCMs). 
20 Over the polar regions, while internal variability plays a larger role than in the other 
geographical regions, model uncertainty remains the dominant term in the total uncer- 
tainty for most of the 21 st century. The role of internal variability is most prominent over 
the Arctic, where it is larger than scenario uncertainty till around 2050 for both scenario 
uncertainty estimates. 

25 Model uncertainty over the Antarctic reduces markedly over the course of the 21st 
century, suggesting that most of this uncertainty is related to the representation of het- 
erogeneous chemical ozone depletion, as expected in the SH. As ODS concentrations 
are reduced, and ozone concentrations recover to their pre-1980 values, CCMs are 
in greater agreement. However, even by the end of the 21st century, model uncer- 
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tainty remains as large or larger than SRES scenario uncertainty over the Antarctic. 
In contrast, over the Arctic model uncertainty increases throughout the 21st century. 
One hypothesis for the growth of model uncertainty over the Arctic is that because 
the response to GHG changes has a wide spread between models, model uncertainty 
5 increases linearly with time as the spread in the changes becomes larger (but the re- 
sponse to GHG changes evolves consistently within each model). 

While scenario uncertainty for both SRES and RCP scenarios grows over the 21st 
century for both polar cap regions there is a larger difference between the estimation 
of this uncertainty from the SRES and RCP scenarios over the Arctic than over the 
io Antarctic. For the Antarctic, scenario uncertainty is broadly similar for the SRES and 
RCP scenario sets, and has similar size to model and internal variability from around 
2050. For the Arctic, RCP scenario uncertainty grows much more strongly than SRES 
scenario uncertainty over the 21st century, but is smaller than model uncertainty in 
both cases. For regions like the Arctic where model uncertainty is large, scenario 
is uncertainty estimates likely have larger error bars because they rely on runs of a small 
number of CCMs which may have different responses to GHG changes. Of the models 
used to estimate scenario uncertainty, Arctic ozone in the last third of the 21st century 
in the REF-B2 simulations is close to the multi-model mean for CAM3.5 and WACCM, 
larger than the multi-model mean in GEOSCCM and smaller than the multi-model mean 
20 in CCSRNIES (Fig. 9.1 1 , Chapter 9, SPARC CCMVal (2010)). 

Over the polar caps, these results suggests that there is very different potential ben- 
efits to improving CCMs. Over the Arctic, reducing model uncertainty could have a 
significant impact on the total uncertainty throughout the 21 st century, since this term 
is large and increases substantially from 2000 to 2100. Over the Antarctic, the reduc- 
25 tion in model uncertainty and the growth of scenario uncertainty means that the impact 
of a reduction in model uncertainty would be largest for the first two-thirds of the 21st 
century. The Antarctic also has a minimum in total uncertainty around 2050, similar 
to that seen in projections of global mean and regional surface temperature (Hawkins 
and Sutton, 2009). 
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4.3 Signal-to-noise ratio of ozone projections 


As in Hawkins and Sutton (2009, 2010), the uncertainty estimates shown above can 
be used to determine other important properties of the ozone projections, such as the 
signal-to-noise ratio (S/N), 


. multi — model mean ozone change 
total uncertainty 

Where S/N exceeds one, there is a robust change in ozone predicted by the multi- 
model ensemble. For near-surface temperature, Hawkins and Sutton (2009) used S/N 
to quantify periods in which the potential information content of projections was great- 
est. In the case of stratospheric ozone projections, we consider the change in total 
column ozone from 2000, the year chosen as the start of our projection period and 
close to the minimum in ozone column amounts. Where S/N is greater than one, this 
suggests that the model ensemble predicts a detectable change from 2000 values. 
Fig. 4 shows estimates of S/N for three of the geographical regions described above, 
with SRES scenario uncertainty (solid), RCP scenario uncertainty (dotted) and without 
scenario uncertainty (dashed) included. The S/N is estimated with and without sce- 
nario uncertainty to allow a more direct comparison with many previous studies and 
assessments of future ozone amounts which have tended to focus on a single GHG 
scenario. 

It is clear from Fig. 4 that, in all three regions, including either SRES or RCP scenario 
uncertainty significantly degrades the ability of the model ensemble to predict changes 
in column ozone amounts, as expected. The date at which projections in all regions 
have S/N greater than one, and hence predict a statistically robust change in column 
ozone, is delayed by around 5 years in the global mean and 10 years for the Antarctic 
and tropical cases. In the global mean case, if the RCP scenario uncertainty is used 
instead of the SRES scenario uncertainty, S/N remains approximately constant after 
2050, as scenario uncertainty becomes larger than model uncertainty. When scenario 
uncertainty is not considered, the signal-to-noise ratio continues to grow, indicating 
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increased confidence in projections. This is an alternative way of showing that CCM 
improvements would likely benefit projections of column ozone by the largest amount 
in the early part of the 21st century, up to the date of ozone return to 1980 values. 

Over the Antarctic, although the signal of ozone increases from 2000 values is larger 
than the global mean signal, the signal to noise ratio is smaller because of the greater 
total uncertainty in all three components. The difference between the estimates of S/N 
using SRES and RCP scenario uncertainty estimates are very small. 

In the tropical region, the evolution of S/N is somewhat different, with a noticeable 
peak in mid-century (where the difference between current and future column amounts 
is greatest) before a decline in the second half of the century. The difference between 
S/N with and without scenario uncertainty is less pronounced for the tropics, with only 
a small reduction in S/N when either SRES or RCP scenario uncertainty is included. 
It should also be noted, however, that the size of S/N in the tropics is smaller than for 
either the global mean or the Antarctic. 

4.4 Uncertainty in ozone return date 

Finally, we consider how different sources of uncertainty influence the calculation of the 
return date for total-column ozone to its 1980 value. To do this, a different calculation 
procedure is required. 

It is assumed that the calculation of return date will be post-hoc (i.e. based on the 
transition of a smooth estimate of the long-term trend in ozone across the zero line). It 
is therefore simple to estimate the uncertainty in return date due to model uncertainty 
(by calculating the variance of return dates across the model ensemble) and due to 
scenario uncertainty (by calculating the variance of return dates across the REF-B2 
and pseudo multi-model mean estimates for each scenario using method 1 and across 
the RCP ensemble using method 2). To calculate the contribution of internal variability 
to uncertainty in return date, a Monte-Carlo approach is adopted. For each model, 
the residuals from the smooth model trend are randomly permuted and added back to 
the model trend to give an alternative evolution of column ozone. By fitting a smooth 
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trend to this new synthetic data and estimating the return date, and then repeating this 
procedure 10,000 times, an estimate of the uncertainty in return date due to internal 
variability in each model can be made. The mean of the internal variability uncertainty 
for the 13 models in the REF-B2 ensemble is used to estimate the overall uncertainty 
due to internal variability. Note that this estimate may be slightly smaller than the real 
contribution of internal variability to the uncertainty in return date, since we neglect 
to preserve the decadal variability present in the noise term when we permute the 
residuals using this method. 

Fractional standard deviation in return date for Arctic, Antarctic and global ozone is 
shown in Fig. 5 as bars which add up to 1 (or 100% of the total standard deviation). 
As in previous calculations, it is clear that a substantial part of the uncertainty in return 
date is associated with model uncertainty. This conclusion is not dependent upon the 
source of the scenario uncertainty estimate, although scenario uncertainty in return 
date is greater for the SRES simulations over the Antarctic and greater for the RCP 
simulations over the Arctic. Over these three key averaging regions, the maximum 
contribution to the fractional standard deviation in ozone return date is around 45% for 
the Antarctic using SRES scenario uncertainty and the minimum contribution is around 
10% for the Antarctic using RCP scenario uncertainty estimates. There is therefore 
strong potential to improve estimates of the return date for ozone in these regions by 
continued CCM development. 


5 Conclusions 

In this study, an attempt to quantify the uncertainty in future projections of total ozone 
column amounts has been made. In particular, a method introduced and tested for 
the CMIP3 models has been adapted and developed for models run as part of the 
Chemistry-Climate Model Validation activity (CCMVal2). Projection uncertainty has 
been divided into three components representing model uncertainty, scenario uncer- 
tainty and uncertainty due to internal variability of the system. Scenario uncertainty 
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has been estimated using two different methods which used scenario simulations from 
both SRES and RCP future emission scenarios. 

When considering scenario uncertainty in the SRES scenarios, total uncertainty in 
ozone projections is roughly constant throughout the 21 st century and is dominated 
5 by model uncertainty. Although scenario uncertainty in the SRES scenario simula- 
tions grows throughout the 21 st century, for most geographical regions and seasons it 
remains smaller than model uncertainty. 

When considering scenario uncertainty in the RCP scenarios, total uncertainty grows 
slightly throughout the 21st century, due to a larger growth in scenario uncertainty than 
io for the SRES simulations. There is an important transition between model uncertainty 
and scenario uncertainty for some regions (notably the global mean ozone and ozone 
in the SH mid-latitudes) with scenario uncertainty dominating projections by the last 
third of the 21st century. This has important consequences for the ability of models to 
predict significant changes to ozone column amounts, which is degraded by scenario 
is uncertainty during this period. 

In general, the consistency of the two independent estimates of scenario uncertainty 
for most diagnostics lends confidence in these estimates. However, the application 
of the scenario uncertainty should proceed with some caution. The GHG scenarios 
used by the models are designed to provide an estimate of the potential range of future 
20 emissions based on vastly different global economic and technological development. 
The scenarios are not equally likely, do not take into account all possible futures and 
should not be taken to indicate an upper bound on the range of potential future emis- 
sions. The newer RCP scenarios have a larger spread in emissions of GHGs com- 
pared to the SRES scenarios used, partly due to the inclusion of the very low GHG 
25 emission scenario (RCP2.6) which represents a future scenario with peak radiative 
forcing around 2050. This scenario does not have an obvious equivalent in the SRES 
scenarios considered. 

An additional source of uncertainty in projections of ozone which we did not consider 
in this study are the mean state biases between CCMs. In all cases, CCM time series 
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of ozone were corrected to their 1 980 values as is customary in the CCM community. 
As shown in, for example, Chapter 9 of the CCMVal report, in many regions models 
have large basic state biases in the total ozone column. If these uncertainties were 
taken into account they would likely further increase the relative contribution of model 
uncertainty to the total uncertainty estimates we have derived. 

The quantification of uncertainty derived in our study also provides some insight into 
the ability of the Chemistry-Climate modelling community to refine projections of future 
ozone amounts by the continued development and improvement of CCMs. The results 
of our analysis suggest that this work would be beneficial for projections of ozone 
amounts in the first half of the 21st century in most regions and particularly in the 
determination of dates of return of ozone amounts to pre-1980 values (a key metric for 
ozone defined by the 2006 WMO/UNEP ozone assessment). In future, similar methods 
could be used to quantify the uncertainty in projections of other parameters of the 
stratospheric climate system in order to attribute the scenario uncertainty to different 
physical processes. It is also important to note, however, that the relationship between 
spread and skill for geophysical models is far from trivial. While it is reasonable to wish 
to reduce overall uncertainty in projections of future ozone, it does not necessarily 
follow that narrowing the uncertainty in these projections will also improve their skill. 

The quantification of uncertainty in ozone projections in this study is far from ideal 
and is sensitive to the assumptions and models used, particularly in constructing esti- 
mates of scenario uncertainty. It is hoped that the results will provide guidance to the 
chemistry-climate community on the benefits that running large multi-scenario ensem- 
bles of CCMs would provide. It is clear from our initial analysis that the benefits in fully 
quantifying and exploring the projection uncertainty from running multi-scenario en- 
semble simulations vary substantially between different geographical regions, seasons 
and time-periods. We re-iterate that an ideal ensemble of simulations for the quantifi- 
cation of uncertainty introduced here would require a large ensemble of models to all 
run at least three different GHG scenarios. 
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Global Mean Annual Mean Ozone Column 



Fig. 1 . Multi-model mean smooth trend in ozone for six models (CCSRNIES, CMAM, MRI, 
SOCOL, ULAQ and WACCM) for the standard REF scenario (black solid line) and for a scenario 
with fixed greenhouse gas concentrations at 1960 levels (black dashed line). Grey lines show 
estimate of the multi-model mean trend in the fixed GHG scenario, calculated by adding the shift 
between the REF and fixed GHG scenario runs and adding this shift to the multi-model mean 
trend from the REF scenario. Estimates produced using the CCSRNIES (yellow) and WACCM 
(blue) models are highlighted in colour. The estimate of the multi-model mean calculated by 
averaging the shift in the CCSRNIES and WACCM models is shown in the red line. 
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Fig. 2. Changes in annual-mean, global-mean, total-column ozone amounts relative to 1980 
values. Black dots indicate observed changes from the NIWA combined and patched ozone 
column dataset. The grey solid line shows the multi-model, multi-scenario mean. Coloured 
wedges indicate the cumulative uncertainty i3Qhis projection associated with one standard- 
deviation estimates of internal variability (orange), model uncertainty (blue) and scenario un- 
certainty (green). The top panel shows calculations of scenario uncertainty using four model 
simulations run with SRES scenarios. The bottom panel shows calculations of scenario uncer- 
tainty using three integrations of CAM3.5 run with RCP scenarios. 
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Fig. 3. Uncertainty in the predicted total-column ozone amounts, relative to 1980 values, esti- 
mated for different geographic regions. Uncertainty is expressed as the one standard deviation 
estimate for interannual variability (orange), model uncertainty (blue) and scenario uncertainty 
(green) and the total (black). Solid green lines show calculations of scenario uncertainty using 
four model integrations run with SRES scenarios. Dashed green lines show calculations of 
scenario uncertainty using three integrations of CAM3.5 run with RCP scenarios. 
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Fig. 4. Estimated signal-to-noise ratio (S/N, see text for details) of the change in total-ozone 
column amounts relative to the multi-model mean amount in 2000. Solid lines show estimates 
which include model uncertainty, internal variability and scenario uncertainty from four model 
integrations run with SRES scenarios. Dotted lines show estimates which include model un- 
certainty, internal variability and scenario uncertainty from three model integrations of CAM3.5 
run with RCP scenarios. Dashed lines show estimates which exclude scenario uncertainty. 
Different coloured lines indicate averages over different geographical regions and seasons. 
Black lines show the global and annual average, red lines show the springtime SH polar cap 
(60-90°S, October) and the green lines show the tropical region (25°N-25°S), annual average). 


32 



Fig. 5. Estimates of the fractional uncertainty in the date of return to 1 980 values of total-column 
ozone amounts due to different sources of uncertainty, for three different geographical regions 
and seasons. The coloured areas indicate the fractional contribution of that type of uncertainty 
to overall uncertainty in the date of ozone return date (orange - internal variability, blue - model 
uncertainty, green - scenario uncertainty). Bars are shown for the northern polar cap during 
spring (60-90°N, March) for the southern polar cap during spring (60-90°S, October) and for 
the global and annual. Left-side bars show calculations of scenario uncertainty using four 
model integrations run with SRES scenarios. Right-side bars shows calculations of scenario 
uncertainty using three integrations of CAM3.5 run with RCP scenarios. 
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Table 1 . Simulations used in the analysis 


Scenario Name 

GHG and ODS forcing 

Models 

Reference 

REF-B2 

SRESA1B 

AMTRAC3 

Austin and Wilson (2009) 



CAM3.5 

Lamarque et al. (2008) 



CCSRNIES 

Akiyoshi et al. (2009) 



CNRM-ACM 

Deque et al. (2007) 
Teyssedre et al. (2007) 



CMAM 

Scinocca et al. (2008) 
de Grandpre et al. (2000) 



GEOSCCM 

Pawson et al. (2008) 



LMDZrepro 

Jourdain et al. (2008) 



MRI 

Shibata and Desushi (2008a) 



MRI 

Shibata and Deushi (2008b) 



SOCOL 

Schraner et al. (2008) 
Egorova etal. (2005) 



ULAQ 

Pitari et al. (2002) 
Eyring et al. (2006) 
Eyring et al. (2007) 



UMSLIMCAT 

Tian and Chipperfield, (2005) 
Tian et al. (2006) 



UMUKCA-UCAM 

Morgenstern et al. (2008) 
Morgenstern et al. (2009) 



WACOM 

Garcia etal. (2007) 

SCN-GHG-SRESA2 

SRESA2 

CCSRNIES 

Akiyoshi et al. (2009) 



GEOSCCM 

Pawson et al. (2008) 

SCN-GHG-SRESB1 

SRESB1 

CCSRNIES 

Akiyoshi et al. (2009) 



WACCM 

Garcia etal. (2007) 

SCN-GHG-RCP2.6 

RCP2.6 

CAM3.5 

Lamarque et al. (2008) 

SCN-GHG-RCP4.5 

RCP4.5 

CAM3.5 

Lamarque et al. (2008) 

SCN-GHG-RCP8.5 

RCP8.5 34 

CAM3.5 

Lamarque et al. (2008) 


















Table 2. Geographical regions considered in the analysis 


Region 

Area 

Season 

Global Mean 

90°S-90°N 

Annual 

Tropics 

25°S-25°N 

Annual 

NH Mid-latitudes 

35°N-60°N 

Annual 

SH Mid-latitudes 

60°S-35°S 

Annual 

NH Polar Cap (Arctic) 

60°N-90°N 

March 

SH Polar Cap (Antarctic) 

90°S-60°S 

October 
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